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Abstract. In this work, we have studied simple models that can be solved 
analytically to illustrate various fluctuation theorems. These fluctuation theorems 
provide symmetries individually to the distributions of physical quantities like the 
classical work (Wc), thermodynamic work (W), total entropy (Astot) and dissipated 
heat (Q), when the system is driven arbitrarily out of equilibrium. All these 
quantities can be defined for individual trajectories. We have studied the number 
of trajectories which exhibit behaviour unexpected at the macroscopic level. As the 
time of observation increases, the fraction of such atypical trajectories decreases, as 
expected at macroscale. Nature of distributions for the thermodynamic work and the 
entropy production in nonlinear models may exhibit peak (most probable value) in the 
atypical regime without violating the expected average behaviour. However, dissipated 
heat and classical work exhibit peak in the regime of typical behaviour only. 
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1. Introduction 

The last two decades have observed a crescendo of research activity in the field of 
nonequilibrium statistical mechanics [1]. One of the major breakthroughs has been the 
emergence of the so-called fiuctuation theorems [T1422]. These are one of the few relations 
that are valid even when one is far away from equilibrium, a region that is beyond 
the scope of the well-established linear response theory. They provide a quantitative 
measure of the probability of a phase space trajectory to dissipate heat, work or entropy 
as compared to the probability of its time-reversed trajectory to absorb the same. In 
other words, it quantifies the probability of violating the average trend which is dictated 
by the second law. The general relation can be written in the form 

Pri-X) 

where a is a constant with inverse dimension of that of x, Pf{x) and Pt{x) are the 
probability densities of x along the forward and the backward processes, respectively. 
As a specific example, let us consider the Crooks' Fluctuation Theorem (CFT) for the 
dissipated work Wd [Tip3] . Wd is related to the thermodynamic work W and free energy 
difference AF between terminal states as Wd = W — AF. Suppose that a Brownian 
particle is initially in thermal equilibrium with a heat bath and it is driven into a 
nonequilibrium state by an external protocol A(t). The dissipated work depends on the 
microstate of the initial equilibrium state and on the stochastic path of the trajectory 
as well as on the final X(t). Hence repeated measurements yield different values for Wd, 
the probability of which obeys 

Pr{-Wd) ' ^ ^ 

/3 being the inverse temperature of the bath. 

The theorem says that the frequency of observing a forward trajectory holds a 
ratio of e^'^'^ with that of observing a time-reversed one. In macroscopic regime, since 
dissipated work increases with system size, the above statement implies that there is 
only small probability for an observer to detect a reverse trajectory. This is consistent 
with the emergence of macroscopic irreversibility (an outcome of the second law). 

The CFT was an example of what are collectively called the transient fiuctuation 
theorems, for which the system must begin in a state of thermal equilibrium with the 
bath and is thereafter allowed to evolve under the given protocol. Using the CFT, the 
Jarzynski Equahty follows (TOlEH], namely, 

(e-/^^) = e-'^^^, (2) 

where (■ ■ ■) denotes ensemble average over all trajectories for a system being prepared in 
an initial equilibrium state and to the same protocol. It may be noted that the LHS of 
(E]) contains nonequilibrium properties whereas the RHS contains equilibrium free energy 
difference between the two terminal states. This identity has gained importance due to 
its ability to calculate the free energy difference from nonequilibrium measurements. If 
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instead of thermodynamic work, we consider the classical work defined below, then the 
Bochkov-Kuzovlev identity follows [20] - |22] . i.e., 

(e-^^=) = 1. (3) 

If the total potential including external protocol is given by U {x, t) (inclusive 
approach), then the thermodynamic work equals W = /J" ^'^g^'^^ dt. If the potential 
is decomposed as an unperturbed potential Uo{x) and perturbing potential Up{x) 
(exclusive approach), then the classical work Wc defined over a time interval r is given 
by Wc = — Jq ^^^q^'*^ x{t)dt. Seifert has generalized [UllIB] the concept of entropy to a 
stochastic trajectory. He has proved the integral fiuctuation theorem, namely, 

(e-^^*-) = 1. (4) 

Here the average is over the ensemble of finite time trajectories. For this theorem to 
hold, the initial state of the system need not be in equilibrium. There are also steady 
state fiuctuation theorems where the system begins and thereafter remains throughout 
in some given (nonequilibrium) steady state. One such theorem is that provided by 
Seifert [T5l[T6] for the total entropy: 

Z(^^_gA....^ (5) 



P(-Astot) 

where Astot is the total change in entropy of the system and the bath. Similar steady 
state fiuctuation theorems can also be derived for work and heat. Once again, the 
connection with the second law is obvious. It can be shown from the above theorems, 
using Jensen's inequality, that on average, we will retrieve the statements of the second 
law: {W) > AF or (Astot) > 0. Similarly, we also obtain (Wc) > 0, as expected for 
macroscopic systems. By separate analysis, one can show that the average heat (Q) 
dissipated into the bath follows {Q) > 0. Here too, given a stochastic trajectory, of 
a system, one can evaluate the dissipated heat Q using the framework of stochastic 
thermodynamics [21]. There are several trajectories which do not obey the properties 
dictated by the second law, i.e., some trajectories exhibit excursions away from the 
typical behaviour, Wc < 0, < AF, Q < and Astot < [25]. It turns out that these 
trajectories are necessary for the satisfaction of the fiuctuation theorems. 

Now one might ask: what is the rate of decay of the number of these atypical 
trajectories as we make the size of the system larger or observe it over a longer period 
of time [32]? We shall show here analytically that if the probability distribution of the 
observable is Gaussian, then the number decays according as the complementary error 
function. Further, if the various observables , namely the thermodynamic work (W), 
classical work (Wc) and the dissipated heat (Q), are measured for each trajectory, then 
the realizations along which W < AF need not be the same as those along which Wc < 0, 
Q < or Asfot < 0. In other words, the atypical trajectories corresponding to one 
observable may be typical with respect to the others. We have also analyzed the nature 
of distributions P{W), P(Wc), P{Q) and P{Astot)- Surprisingly, the distributions for 
thermodynamic work and the entropy production in nonlinear models may exhibit most 
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probable value in the atypical regime without violating the expected average behaviour. 
However, the dissipated heat and the classical work exhibit peak in the regime of typical 
behaviour only. For simplicity, throughout our analysis, the system is driven out of 
equilibrium by the same sinusoidal force only. 



2. Harmonic potential 

2.1. Thermodynamic work distributions 

We consider the following system: a Brownian particle is placed in a harmonic potential 
and is in contact with a thermal bath at temperature T. The system is first allowed to 
equihbrate with the bath, and thereafter subjected to a given time dependent protocol 
f{t). The bath is assumed to be infinite and hence always stays at equilibrium. The 
system, however, goes out of equilibrium. We will consider a sinusoidal perturbation: 
f{t) = Asin{ut + 0). The particle follows the overdamped Langevin equation: 

7i = -fcx + /(t)+e(t), (6) 

where the noise is white and Gaussian, so that (^(t)) = and (^(t)^(t')) = 2'yTS(t — t'). 
k is the spring constant. 
The solution of is 

x{t) = xoexp{-kt) + / dt'e''''/^[Asm{ujt' + 0) + ^{t')]. 

1 Jo 

(7) 

Here, xq is the initial position of the particle, which is supposed to be sampled from a 

thermal distribution: P{xq) = exp [— ^ (xq — ^sin0)^]. The above equation shows 
that the position variable is linear in ^{t) and hence is destined to follow a Gaussian 
distribution as well. The thermodynamic work is defined as |T0] 



Wir) = I dt xit)^, (8) 



which says that even the work follows a Gaussian distribution. Thus we can write 

r2 



(9) 



2^2 

It can be readily shown that the variance is given by 

a^ = {W^)-{Wf = 2T {{]¥)- AF), (10) 
where AF is the change in equilibrium free energy, given by 

AF = -—sin^{ujT + (f)) + —sm'^(f). (11) 

Here, r is the time of observation. The relation (11 01) is referred to as the fluctuation- 
dissipation theorem. 

Using the relation and substituting this in ([9]), one readily obtains the analytical 
expression for P{W) in terms of the system parameters. The expression for (W) has 



been given in Appendix A 
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2.2. Classical work distributions 

The classical work done by the system is defined through 

W,= [ f{t)xdt = W-fiT)x{r) + f{0)x{0). (12) 



(13) 







Once again, it can be trivially shown to be Gaussian and is given by 



W) = ^exp 



2al 

with = 2T{Wc)- The value of (Wc) has been given in Appendix A 



2.3. Entropy distributions 

Entropy is generally considered as an ensemble property. But Seifert has generalized 
the concept of entropy to a single stochastic trajectory. The total entropy production 
{Astot) along a single trajectory involves both the system entropy (As) and the entropy 
change in the medium (Asm)- The change in medium entropy is given by 

As^ = |, (14) 

where Q is the heat dissipated into the bath, which can be readily calculated for a 
stochastic trajectory generated by the Langevin equation. The nonequilibrium entropy 
of the system is defined as p^[T6]. 

s{t) = -\nP{x{t),t), (15) 

where P{x,t) is the position probability density of the particle. It immediately follows 
that the change in system entropy for any trajectory of duration r is given by 

where P{x, r) and P{xo) are the probability densities of the particle positions at time 
t = and at final time r, respectively. Thus for a given trajectory x{t), the system 
entropy s{t) depends on the initial and final probability densities, hence containing 
information about the whole ensemble. The total entropy change over a time interval r 
is given by 

Astot = As^ + As. (17) 

Astot obeys the integral fiuctuation theorem [TSlfTG] : 

(e-^**-) = 1. (18) 

For our problem, the total entropy becomes 

W-AU , P{x,t) 
T P{xo) 
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The first term on the RHS is obtained by replacing Q hj W — AU which follows from 
the first law. Here AU is the change in the internal energy of the system, which is given 
by 



AU = U{x, t) - Uixo) = hx' - xfir) - hxl + xo/(0), 



(20) 



where /(r) = y4sin(a;r + cf)) and /(O) = Asmcf). Initially the system is prepared in 
thermal equilibrium given by 



P{xo) 



27tT 



exp 



2T 



(21) 



The evolution of the system through Langevin dynamics leads to the final distribution 

k{x-{x)r] ^22) 



k 
2^ 



exp 



2T 



Here, 



(x) = (xo) e-^^ + Ae-^^ [ dte^' sin(wt + 0) 

Jo 



A sin I 
k 



A 



- [k sin((X'r + 0) — w cos(ajr + 



A;2 + ^2 I 
+ e'^'^iuj cos 6 — k sin ( 



(23) 



Using the above relations, Astot becomes 

■ ((x) sin 



(W) A k 
(Ast^t) = ^ + -{{x) sm{uT + <P)- (xo) sin 0) - ^((x)' - (xq)') 



m 

T 2k{k^ + uj^yT 
A^e-'^W 



, w sm I 



k cos( 



+ 

+ 



A;(P + w2)2T 
^2 cos 20 A'^k{e + 3u^ 



{k cos + w sin 0) [k cos{ujt + 
cos(2a;r + 20) 



u sin(ci;r + 



AkT 4(A;2 + u'^yr 
A^u^ 



Akik'^ + oj^T 



[k^ + + 2ku sin(2wr + 20)] . 



(24) 



Again, Astot for the given particular thermal distribution becomes linear in x and 
hence it becomes Gaussian and is given by 



P{Ast. 



ot 



2Txa\ 



exp 



{Astot - {Astot)f 
2a2 



(25) 



where al = 2{Astot)- The Gaussian distribution P{Astot) along with the above obtained 
equation for variance implies the validity of the detailed fluctuation theorem, which is 
only valid for the linear potential in the transient case, provided the initial distribution 
is canonical 128]. 
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2.4- Heat distributions 

Unlike W, Wc and Astot, the heat is not hnear in x (as shown below) and hence the 
distribution is not Gaussian. Q is given by 

Q = W-AU= - f dt x{t)^ - h{x^ - xl) 

J Q ^ 

+ x/(r)-a;o/(0). (26) 

The distributions for Q cannot be obtained analytically. Hence we resort to calculating 
Q using numerical simulation. However, it may be noted that the Fourier Transform of 
P{Q) can be obtained analytically pT|[T^. 



3. Results and discussions 



In figures 1(a), (b), (c) and (d) we have plotted the probability densities for W, 
Astot and Q respectively for different values of time r = r(^/4, 5x^^/4 and 9r^/4, as 
indicated in the these figures. Here r^^ is the period of the external drive, namely, 
= 2tt/uj. We have taken all the physical quantities in dimensionless forms and have 
taken = throughout our analysis. As anticipated, W, Wc and Astot distributions 
are Gaussian and their most probable values (peaks in the distributions) are positive 
and shifts towards right with increase in time of observation. The distribution for Q 



is non-Gaussian (figure 1(d)), as anticipated from the previous discussion. In all these 
distributions, we find finite probability for the values of physical quantities that are 
atypical {W < AF, Wc < 0, Astot < and Q < 0). These trajectories are sometimes 
referred to as the transient second law violating trajectories. Fraction of such trajectories 
decrease as a function of the time of observation. The analytical expressions for such 
trajectories can be found out. For the thermodynamic work W, this fraction is 
obtained by integrating P(W) from — oo to AF. Similarly, fw^ and /Astot obtained 
by respectively integrating P{Wc) and P{Astot) from — oo to 0. The analytical results 
are 



/a.... = ierfc (i V(As„)) . (27c) 

These have the general form / = -^e"'^'^ in the time-asymptotic limit. Further, it 
follows from the above equations that the fraction of violations cannot cross 0.5. 

In figure[2|, we have plotted the fraction of transient second law violating trajectories 
for W, Wc, Astot and Q. The first three are plotted using our analytical results, fq for Q 
has been obtained from numerical simulation. For this linear problem, we observe some 
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(c) (d) 

Figure 1. (a) Analytical distributions of thermodynamic work of different times 
of observation, (b) Analytical distributions of classical work of different times of 
observation, (c) Analytical distributions of total entropy for different observation 
times, (d) Distribution of dissipated heat for harmonic potential for different values of 
observation time. 
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Figure 2. Fraction of atypical trajectories for harmonic potential, as a function of 
time of observation (in units of Ti^). The inset shows a magnified portion of the plots 
of fw and fAstat ■ 
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Figure 3. Fraction of atypical trajectories for harmonic potential as a function of 
temperature. The inset shows a magnified portion of the plots of and ji^stat ■ 



systematics, i.e., we note that the number of atypical trajectories are larger for Q and 
followed by the plots of fi^stot jw which are seemingly coincident, and the lowest plot 
is that of fwa- However, the inset shows a magnified part of the plots of fi^stot ^^'^ fw, 
where the former is observed to be slightly higher than the latter. This extremely small 
difference is observed in the parameter regime A,u ^ 1. By analysis of the explicit 
expression ( fT9l) . it can be shown that in this regime, Astot ~ {{W) — AF)/T. Thus 
the violations become nearly same, which follows from equations i\27a\i and fl27cp . The 
difference can be made large by changing the parameters. However, plotting all the four 
curves on the same graph does not bring clarity, but the conclusions remain unchanged. 
The systematics mentioned above for the fractions of atypical trajectories is a feature 
of the linear problem only. This can be noted from the next section. As the time of 
observation increases, the number of atypical trajectories decreases exponentially and 
goes to zero, thus leading to the well-defined classical thermodynamic behaviour. We 
would like to emphasize that given a trajectory, if it violates the relation W > AF, this 
need not imply that the same trajectory will violate Wc > or As tot > or Q > 0. This 
also follows from the simple fact that the fraction of violating trajectories is different for 
different physical quantities, and the trend seen in figure [2] remains same as a function 
of temperature, which has been plotted in figure [3l Here too, the curves do not cross. 
The above general observations hold for the case of a linear model. Some of these 
observations change qualitatively for non-linear systems, which we study below. 



4. Non-linear model 



We now study the dynamics of a Brownian particle in a nonlinear system. The potential 
is of the form |29| 



V{x) 



+ 



k. 



\x\ 



(28) 




Figure 4. (a) Distribution of thermodynamic work for double well for different values 
of observation time, (b) Distribution of classical work for double well for different values 
of observation time, (c) Distribution of total entropy for double well for different values 
of observation time, (d) Distribution of dissipated heat for double well for different 
values of observation time. 




Figure 5. Distributions for thermodynamic work, classical work, dissipated heat and 
total entropy for double well. 
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Figure 6. Fraction of atypical trajectories in double well potential, as functions of 
time of observation (in units of t^j). 
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Figure 7. Fraction of atypical trajectories in double well potential, as functions of 
temperature . 



This particular potential has been studied in connection with stochastic resonance (SR) 
and is exhibits SR only for q > 2 and for g < 2, it does not exhibit SR. For our 
analysis, we have taken q = 4 and k = 1. All the physical quantities have been 



obtained numerically using the Heun's method. In figure 4(a) (b), (c) and (d) we 



have plotted distributions P{W), P{Wc), P{Astot) and P{Q). All the parameters 
are given in the figure. Initially the system is in equilibrium. In all figures we have 
multipeaked distributions due to intrawell and interwell dynamics. The protocols are 
applied for t = 5x^^/4 and 9x^^/4. The number of peaks in the distribution increase 
by two in each successive case. This corresponds to additional crossings of the particles 
over the intervening potential barrier. This not only broadens the distribution but its 
centre of mass or mean shifts to the right. The peak corresponding to the initial well 
motions [30|l3T] shrink fast. The change in the free energy AF of the system is the 
difference between the free energies at the final and the initial values of the protocol, 
and is calculated by using the Jarzynski equality. We get AF = —0.31 for A = 0.4. 
We also obtain the values {e'^") = 1.00 and (e~^'^*°') = 1.07, consistent with equations 
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(jl]) and ([31), respectively, within our numerical precision. Our protocol, as mentioned 
in the beginning, is a sinusoidal perturbation applied over different observation times 
as mentioned in the plots. It is clear that in all the cases, the fraction of atypical 
trajectories decreases as we increase the time of observation. Interestingly, P{W) and 
P{Astot) for t = t/4: exhibit the most probable value in the atypical region. This is 
quite interesting. However, it is to be noted that (W) and {Astot) are greater than AF 
and zero, respectively. That is the typical behaviour at the macroscopic scale. In figure 
ini all the distributions are plotted on the same graph for comparison. The parameters 
are mentioned in the figure. We clearly see that P{W) and P{Astot) exhibit the peak 
corresponding to the most probable value in the region of atypical values. This is not a 
generic observation. This depends crucially on the values of the parameters, the time of 
observation and the protocol. However, we have verified with various protocols that the 
peak corresponding to the most probable value for Wc and Q always lie in the typical 
region. Average values of all the physical quantities increase with the time of observation 
as they are extensive in nature, as in the linear case. In figure El we have plotted the 
fractional violations fw, fw^i f^stot and /q as functions of the time of observation. 
These fractions decrease exponentially in time and coalesce time asymptotically, as in 
the linear case. Again, unlike the linear model (wherein fq > f Astot > fw > fwjy 
this trend is not maintained. Even two curves may cross, as shown in figure [6l This is 
quite clear from the observations in figure U\ where we have plotted fractional violations 
versus temperature. We can clearly see that with increase in temperature, the plots 
cross each other. 

5. Conclusions 

In our work, we have studied fluctuations in physical quantities such as thermodynamic 
work, classical work, total entropy and heat when the system is driven out of equilibrium. 
Our treatment is based on stochastic thermodynamics which gives prescription to 
calculate W, Wc, Astot, Q, etc., for a given trajectory followed by the particle during 
evolution. Since we consider ensemble of trajectories, all the physical quantities become 
fluctuating variables, i.e., they take on random values depending on the trajectory 
of the particle. Unlike in thermodynamics, these physical quantities take on well- 
defined probability distributions which in turn satisfy the fluctuation theorems. We 
have analytically calculated P{W), P{Wc) and P{Astot) for a sinusoidally driven linear 
system. The glaring differences between the linear and the nonlinear systems have been 
pointed out. Systematics which are present in linear systems are absent in nonlinear 
systems. These results are amenable to experimental verifications. We would also like 
to emphasize that in both the linear and in the nonlinear models, we observe that the 
fraction of trajectories violating typical behaviour are not greater than 50%. 
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Appendix A. Expressions for (W) and (Wc) for harmonic potential under 
sinusoidal driving 

{W) = _ -A^[cos(2a;T + 20) - cos(20)] + ^ 



+ —— — [cj sinfcuT + (f)) — k cosIcut + (j))] (k sin (j) — ou cos 0) 

{k'^ + uj^y 

+ -j-r^ ?rTT7 (k sin 6 — uj cos 6) (k cos 6 — ui sin 0) 

74^Cc;sin0. , . , ,x , / ,\-> , , • ,i 
— — e |a;sin(a;T + 0) — /f;cos(a;T + 0)} + kcoscp — a;sin0 . 

(A.l) 



(^c) = ,^ ,J cos(2a;T + 20) - cos(20)] + ^ 



+ 4(A;^+^a;2) ['^"^^^^ + ^'^^ " '^"^^'^^^ 

+ —— -r- [o; sin(a;r + 0) — A; cos(a;r + 0)] (A; sin — a; cos 0) 

+ 77o oVo sin — a; cos 0) (/c cos — a; sin 0) 

+ —5 r sin(a;r + 0)[a;cos0 — A;sin0]. (A. 2) 

A;"' + (x!^ 
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